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Abstract In this chapter we discuss how the results developed within the theory 
of fractals and Self-Organized Criticality (SOC) can be fruitfully exploited as in- 
gredients of adaptive network models. In order to maintain the presentation self- 
contained, we first review the basic ideas behind fractal theory and SOC. We then 
briefly review some results in the field of complex networks, and some of the mod- 
els that have been proposed. Finally, we present a self-organized model recently 
proposed by Garlaschelli et al. [Nat. Phys. 3, 813 (2007)] that couples the fitness 
network model defined by Caldarelli et al. [Phys. Rev. Lett. 89, 258702 (2002)] 
with the evolution model proposed by Bak and Sneppen [Phys. Rev. Lett. 71, 4083 
(1993)] as a prototype of SOC. Remarkably, we show that the results obtained for 
the two models separately change dramatically when they are coupled together. This 
indicates that self-organized networks may represent an entirely novel class of com- 
plex systems, whose properties cannot be straightforwardly understood in terms of 
what we have learnt so far. 



1 Introduction 

Several important results on both the empirical characterization and the theoretical 
modelling of complex networks have been achieved in the last decade 0]|2][3][4][5l. 
Among the factors that have rendered this fast progress possible, one should surely 
acknowledge the unprecedented possibility to digitally store, and computationally 
analyse, huge datasets documenting the large-scale organization of biological, tech- 
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nological, and socio-economic systems. This has determined an empirically well- 
grounded problem of information extraction from a new form of data, where many 
units (vertices) are mutually interconnected by links (or edges), requiring novel 
paradigms for the identification of relevant patterns, and possibly regularities. A 
second reason is surely the scientific awareness, steadily grown during at least the 
last three decades, of the ubiquitous presence in nature of collective and emergent 
phenomena resulting from the interaction of many units within a complex system. In 
particular, the developments achieved within the broad fields of statistical physics, 
nonlinear dynamics, critical phenomena, fractal geometry, spin glasses, and many- 
body theory have contributed to the formation of a modern and interdisciplinary 
perspective, whose major focus is the (often unexpected) role of the interactions 
between constituents, rather than the individual details of the latter. Within this re- 
search field, whose boundaries are rather blurred, a diverse set of tools to handle the 
complexity of heterogeneous systems was developed. When the empirically-driven 
pressure towards the understanding of networks built up, the scientific community 
was faced with the possibility, and the challenge, to apply these tools to a genuinely 
new problem. As a result, some universal features across different real-world net- 
works were identified, and theoretical models were proposed to reproduce and in- 
terpret them. At the same time, the scientific horizon extended even further, since a 
complete framework was not there to tackle the problem yet. Indeed, a satisfactory 
and unified approach to complex networks is still lacking, and this exciting field 
continues to attract the interest of a large community of scientists extending across 
different disciplines. 

Broadly speaking, the main lines of research on networks that have been traced in 
the last decade are: i) the definition and the empirical analysis of the static topolog- 
ical properties of networks; ii) the modelling of (either static or growing) network 
formation; Hi) the effects that the topology has on various dynamical processes tak- 
ing place on networks. Some useful references HIEIEIIHEI P resent reviews of these 
results. More recently, a few attempts to provide a unified approach to the problem 
have been proposed, exploiting the idea that these aspects of networks should in 
the end be related to each other. In particular, it has been argued that the complex- 
ity of real-world networks is in the most general case the result of the interplay 
between topology and dynamics. While most studies have focused either on the 
effects that topological properties have on dynamical processes, or on the reverse 
effects that vertex-specific dynamical variables have on network structure, it has 
been suggested that one should consider the mutual influence that these processes 
have on each other. This amounts to relax the (often implicit) hypothesis that dy- 
namical processes and network growth take place at well separated timescales, and 
that one is therefore allowed to consider the evolution of the fast variables while the 
slower ones are quenched. Remarkably, one finds that the feedback between topol- 
ogy and dynamics can drive the system to a steady state that differs from the one 
obtained when the two processes are considered separately (6). These results imply 
that adaptive networks generated by this interplay may represent an entirely novel 
class of complex systems, whose properties cannot be straightforwardly understood 
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In what follows we shall review our contribution to this line of research. In partic- 
ular, we shall present a self-organized model (6) where an otherwise static model of 
network formation driven by vertex fitness is explicitly coupled to an extremal 
dynamics process (8) providing an evolution rule for the fitness itself. In order to 
highlight the novel phenomena that originate from the interplay between the two 
mechanisms, we first review the main properties of the latter when considered sep- 
arately. In section|2]we recall some aspects of scale invariance and Self-Organized 
Criticality (SOC), and in particular the biologically-inspired Bak-Sneppen model 
lH where the extremal dynamics for the fitness was originally defined on static 
graphs. In section [3] we briefly review complex networks and in particular the so- 
called fitness model of network formation [7|, where the idea that network properties 
may depend on some fitness parameter associated to each vertex was proposed. Fi- 
nally, in section 2] we present the self-organized model obtained by coupling these 
mechanisms. The order of the presentation is also meant to highlight the fruitful 
synthesis that, as we have already mentioned, has originated by the application of 
ideas inherited by the previous understanding of complex systems to networks. 



2 Scale invariance and self-organization 

Self-similarity, or fractality, is the property of an object whose subparts have the 
same shape of the whole. At first, self-similarity appeared as a peculiar property 
of a limited class of objects. Only later, due to the activity of Benoit Mandelbrot 
ll9l [T0ll . it turned out that examples of fractal structures (even if approximate due to 
natural cutoffs) are actually ubiquitous in nature. Indeed, in an incredible number of 
situations the objects of interest can be represented by self-similar structures over a 
large, even if finite, range of scales. Examples include commodity price fluctuations 
|9l , the shape of coastlines iflOl . the discharge of electric fields 1111 . the branching 
of rivers 1121 . deposition processes ff3l . the growth of cities 11141 . fractures fl5l . 
and a variety of biological structures lfl6l . 



2.1 Geometric fractals 

Due to this ubiquity, scientists have tried to understand the possible origins of frac- 
tal behaviour. The first preliminary studies have focussed on mathematical functions 
built by recursion (Koch's snowflake, Sierpihski triangle and carpet, etc.). Based on 
these examples, where self-similar geometric objects are constructed iteratively, 
mathematicians introduced quantities in order to distinguish rigorously between 
fractals and ordinary compact objects. 
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For instance, one of the simplest fractals defined by recursion is the Sierpinski 
triangle, named after the Polish mathematician Waclaw Sierpinski who introduced 
it in 1915 ifTTl . When the procedure shown in Fig[T]is iterated an infinite number 



Fig. 1 First steps in the A A A A A 

iteration procedure denning a a ^ ^ 4 * / A 

the Sierpinski triangle. ^n^^L AAAA AaaaVA AAAA 



of times, one obtains an object whose empty regions extend at any scale (up to the 
maximum area delimited by the whole triangle). It is therefore difficult to measure 
its area in the usual way, i.e. by comparison with another area chosen as the unit 
of measure. A way to solve this problem is to consider a limit process not only 
for the generation of the fractal, but also for the measurement of its area. Note that 
at the first iteration we only need three triangles of side length 1/2 to cover the 
object (while for the whole triangle we would need four of them). At the second 
iteration we need nine covering triangles of side 1 /4 (while for the whole triangle 
we would need sixteen of them). In general, for a compact triangle the number of 
triangles needed grows quadratically as we reduce the size of the covering triangles. 
The (scale-dependent) number of objects required to cover a fractal is at the basis 
of the definition of the fractal dimension D. Formally, if N(e) is the number of 
De -dimensional volumes of linear size e required to cover an object embedded in a 
metric space of Euclidean dimension De, then the fractal dimension is defined as 

D=\tm V 2 , (1) 

lnl/e ' 

which approaches an asymptotic value giving a measure of the region occupied by 
the fractal. 

For a compact object the fractal dimension gives the same value as the Euclidean 
dimension De- Indeed, for the above compact triangle D = De = 2. To see this, 
note that at the first iteration the number of necessary triangles is 4 and l/e is 2, 
therefore D = jj4 = 2. At the next iteration l/e is 4 and the number of covering 
triangles is 16 so that again D = = 2. Clearly, the same value of D is found at 
all subsequent iterations, and therefore also in the limit e — > 0. By contrast, for the 
Sierpinski triangle it is easy to realise that at the k-th iteration the linear size of each 
covering triangle is e = 2~ k and that N = 3 such triangles are needed. This implies 

D=lim^ = ^ 1.58496... (2) 
e^o lnl/e In 2 

Now we find that D < De = 2. Therefore the fractal dimension measures the differ- 
ence between the compactness of a fractal and that of a regular object embedded in 
a space of equal dimensionality. In the present example, D is lower than 2 because 
the Sierpinski triangle is less dense than a compact bidimensional triangle. D is also 
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larger than 1 because it is denser than a one-dimensional object (a line). Note that 
the above formula can be rewritten in the familiar form of a power law by writing, 
for small £, 

N(e) oc £-° (3) 

This highlights the correspondence between the geometry of a fractal and scale- 
invariant laws. 



2.2 Self-Organized Criticality 

Despite their importance in characterizing the geometry of fractals, purely mathe- 
matical algorithms are not helpful in order to understand whether a few common 
mechanisms might be responsible for the fractal behaviour observed in so many dif- 
ferent, and seemingly unrelated, real-world situations. This has shifted the interest 
towards dynamical models. Indeed, open dissipative systems are in many cases as- 
sociated with fractals for more than one reason. Firstly, attractors in the phase space 
of a nonlinear dynamical system can have a fractal geometry; secondly, their evo- 
lution can proceed by means of scale-invariant bursts of intermittent activity ifTHl 
extending over both time and space. In general, these features are obtained when 
a driving parameter of the nonlinear dynamical system is set to a crossover value 
at which chaotic behaviour sets on. When this occurs, the nonlinear system is said 
to be at the "edge of chaos". Another situation where self-similarity is observed 
is at the critical point of phase transitions. For instance, magnetic systems display 
a sharp transition from a high-temperature disordered phase, where microscopic 
spins point in random directions and generate no macroscopic magnetization, to a 
low-temperature ordered phase where almost all spins point in the same direction, 
determining a nonzero overall magnetization. Exactly at the critical transition tem- 
perature, spins are spatially arranged in aligned domains whose size is power-law 
distributed. This means that domains of all sizes are present, with a scale-invariant 
pattern. 

In both cases, in order to explain the ubiquity of self-similar systems one should 
understand why they appear to behave as if their control parameter(s) were system- 
atically fine-tuned to the critical value(s). This point led to the idea that feedback 
effects might exist, that drive the control parameter to the critical value as a sponta- 
neous outcome of the dynamics. In this scenario, it is the system itself that evolves 
autonomously towards the critical state, with no need for an external fine-tuning. 
This paradigm is termed Self-Organized Criticality (SOC) (for a review see Ref. 
lfl9ll and references therein). At a phenomenological level, SOC aims at explaining 
the tendency of open dissipative system to rearrange themselves in such a way to de- 
velop long-range temporal and spatial correlations. Why this happens is still a mat- 
ter of debate, even if some authors claimed that this behaviour may be based on the 
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minimization of some energy potential |f20l[2Tl l22lPl Also, it has been proposed that 
a temperature-like parameter can actually be introduced for these systems |[24l|25ll , 
and shown to lead to SOC only if fine-tuned to zero. This supports the hypothesis 
that SOC models are closely related to ordinary critical systems, where parameters 
have to be tuned to their critical value, the fundamental difference being the feasi- 
bility of this tuning. 

There are several examples of simplified models showing SOC, and most of them 
have a common structure. In practice, two classes of SOC models attracted many 
studies: the class of sandpile models l26l and the class of models based on extremal 
dynamics such as the Bak-Sneppen (8) and Invasion Percolation l27l models. In 
what follows we briefly review these examples. 



2.2.1 Sandpiles 

One prototype is represented by sandpile models l26l . a class of open dissipative 
systems defined over a finite box A in a cZ-dimensional hypercubic lattice. In d = 2 
dimensions, one considers a simple square lattice. Any site ; of the lattice is assumed 
to store an integer amount Zi of sand grains, corresponding to the height reached by 
the sandpile at that site. At every time step one grain of sand is added on a randomly 
chosen site ;, so that the height Zi is increased by one. As long as z, remains below 
a fixed threshold, nothing happens 0. But as soon as Zi exceeds the threshold, the 
column of sand becomes unstable and "topples" on its nearest neighbours. Therefore 
the heights evolve according to 

Zi -> zi - Ah (4) 

where 

{2d k = i 
— 1 k nearest neighbor of i (5) 
otherwise. 

This process is called toppling. As the neighbouring sites acquire new grains, they 
may topple in their turn, and this effect can propagate throughout the system until 
no updated site is active, in which case the procedures starts again with the addition 
of a new grain. While the amount of sand remains constant when toppling occurs 
in the bulk, for topplings on the boundary sites (; G dA) some amount of sand falls 
outside and disappears from the system. In the steady state of the process, this loss 
balances the continuous random addition of sand. 



1 Interestingly a similar claim has been made for networks as well 1231 . 

2 Different functions of the height Zi can be defined: for example the height itself, the difference of 
height between nearest neighbours (first discrete derivative of the height), the discrete Laplacian 
operator of height (second discrete derivative), and so on. 
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All the toppling events occurring between two consecutive sand additions are 
said to form an avalanche. One can define both a size and a characteristic time for 
an avalanche. The size of an avalanche can be defined, for instance, as the total 
number of toppling sites (one site can topple more than once) or the total number 
of topplings (it is clear that these two definitions give more and more similar results 
as the space dimension increases). In order to define the lifetime of an avalanche, 
one must first define the unit timestep. The latter is the duration of the fundamental 
event defined by these two processes: 

• a set of sites becomes critical due to the previous toppling event; 

• all such critical sites undergo a toppling process, and the heights of their neigh- 
bours are updated. 

Then the lifetime of an avalanche can be defined as the number of unit timesteps 
between two sand additions. The fundamental result of the sandpile model is that at 
the steady state both the size s and the lifetime t of avalanches are characterized by 
power law distributions P{s) ~ s~ x , Q(t) ~ l26l . Therefore the model succeeds 
in reproducing the critical behaviour, often associated to phase transitions, with a 
self-organized mechanism requiring no external fine tuning of the control parame- 
ter. Note that the grain addition can be viewed as the action of an external field over 
the system. Similarly, the avalanche processes can be viewed as the response (relax- 
ation) of the system to this field. The spatial correlations that develop spontaneously 
at all scales indicate that the system reacts macroscopically even to a microscopic 
external perturbation, a behaviour reminiscent of the diverging susceptibility char- 
acterizing critical phenomena. 

2.2.2 The Bak-Sneppen model 

A model that attempts to explain some key properties of biological evolution, even 
if with strong simplifications, is the Bak-Sneppen (BS) model |8. 28 j. It is defined 
by the following steps: 

• N species are arranged on the sites of a 1 -dimensional lattice (a chain, or a ring 
if periodic boundary conditions are enforced); 

• a fitness value x,- (sometimes interpreted as a fitness barrier) is assigned to each 
species i, drawn randomly from a uniform distribution in the interval [0,1]; 

• the site with the lowest barrier and its nearest neighbours are updated: new ran- 
dom fitness values, drawn from the same uniform distribution on the unit interval, 
are assigned them. 

The basic idea behind the model is that the species with the lowest fitness is the 
one that is most likely to go extinct and replaced by a new one. Alternatively, the 
update is interpreted as a mutation of the least fit species towards an evolved species 
representing its descendant or offspring. Finally, one can interpret xi as the barrier 
against mutation for the genotype of species ;: the higher the barrier, the longer the 
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time between two modifications of the genetic code. The species with lowest bar- 
rier is therefore the first to evolve. In any case, the reason for updating the nearest 
neighbours is the same: the mutation of one species changes the state of all the 
interacting species (for instance, both predator and prey along the food chain). The 
effect of this change on the fitness of the nearest neighbours is not known a priori (it 
may be beneficial or not), and is modelled as a random update of their fitness as well. 

If the procedure described above is iterated, the system self-organizes to a criti- 
cal stationary state in which almost all the barriers are uniformly distributed over a 
certain threshold value T = 0.66702 ±0.00008 (29) (see FigEJ left panel). In other 
words, the fitness distribution evolves from a uniform one in the interval [0, 1] to 
a uniform one in the interval [%, 1]. In this model an (evolutionary) x-avalanche is 
defined as a causally connected sequence of mutations of barriers, all below a fixed 
value x. In this way the size of an x-avalanche is uniquely defined as the number 
of mutations between two consecutive configurations where all barriers are above 
x. For x w t the avalanche distribution is a power law P(s) s~ x with an exponent 
X = 1.073 ±0.003 EH (see FigH right panel). 




* s 

Fig. 2 Left: plot of the probability distribution of fitness values at the steady state in the Bak- 
Sneppen model with 500 species. Right: the probability distribution P(s) for the size of a critical 
T-avalanche. 

The Bak-Sneppen model is a prototype mechanism generating fractal phenom- 
ena as an effect of extremal dynamics 1301 . It also provides a possible explanation 
for the phenomena of mass extinctions observed in the fossil records OP , some 
analyses of which have indicated that extinction sizes are power-law distributed. 
Rather than considering large-scale extinctions as triggered by external catastrophic 
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events (such as meteorites or major environmental changes) and small-scale extinc- 
tions as caused by evolutionary factors, the model shows that a power-law distri- 
bution of extinction events may be interpreted as the outcome of a single internal 
macroevolutionary process acting at all scales. 

The Bak-Sneppen model has been studied within a variety of different frame- 
works ranging from numerical simulation 1 29., 32], theoretical analysis 11331 . renor- 
malization group techniques [34 35], field theory l36l . mean-field approximations 
1281 [30l and probabilistic approaches (run time statistics) 13711381 . It has also been 
defined on higher-dimensional lattices and more general graphs, including complex 

networks [8]|28l[3S[39]|40l|4T]|m|43, which we the sub j ect of the next section. 
For a recent review on this model see ref. 11441 and references therein. Being so well 
studied, the Bak-Sneppen model is ideal for studying the effects introduced by a 
feedback mechanism between fitness dynamics and topological restructuring. For 
this reason, it is at the basis of the adaptive model |fj | that we shall present in detail 
in section |4] 



3 Complex networks 

Networks are encountered anywhere in nature 0] El E IU |3J ■ For example, in bi- 
ology they describe protein interactions, metabolic reactions, and gene expressions 
E5j|46]|47]]. In the different context of ecology, food webs ||48]|49) report predator- 
prey or host-parasite interactions, and taxonomic trees are used to classify different 
species l50l IBTl l52l . Socio-economic systems display a strongly networked struc- 
ture as well, for instance when considering the relationships between firms l53ll or 
trading countries l54| . Technology produces network structures as well, the most 
striking evidences of which being the Internet and the WWW 1331 l56l l57l . During 
the last decade, it has been found that the overwhelming majority of real-world 
networks is characterized by nontrivial features, leading to the term "complex net- 
works". As for the notion of "complex systems", a rigorous and/or widely accepted 
definition of complexity does not exist. Nonetheless, what is generally meant is that 
many topological properties of real networks are not easily reproduced by simple 
graph models. Quite surprisingly, these properties are often shared by networks of 
very different nature, suggesting common organization mechanisms. 



3.1 Network properties 

One of the widespread features observed in real networks is a scale-free distribution 
P{k) °c k~Y for the degree k, representing the number of links emanating from a 
vertex. More formally, for an undirected network with N vertices, the degree of 
each vertex ; can be expressed as 
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k = Y, a ij ( 6 ) 

j 

where a, 7 = 1 if a link between i and j is there, and au = otherwise. The empirical 
finding that k, is power-law distributed indicates that even if the majority of vertices 
has a small number of neighbours, some of them (the "hubs") are connected to many 
vertices. 



Another nontrivial property is the (anti)correlation between degrees of neigh- 
bouring vertices: vertices with a large value of the degree tend either to "attract" 
or to "repel" vertices with similar degree, a property known as assortativity or dis- 
assortativity respectively 0] |4). This can be quantified by measuring the average 
degree of the nearest neighbours of a vertex ;, defined as 

k „„ _ Lj'lijkj = I ; a "//'./A 

and plotting it versus k[. Assortative mixing corresponds to an increasing trend, 
while disassortative mixing corresponds to a decreasing trend of the resulting curve. 
In absence of correlations, a flat behaviour would be observed. 



Another observed tendency is the presence of many more triangles (fully con- 
nected triples of vertices) than expected by chance, a feature denoted clustering 
IU 3). For each vertex i, the clustering coefficient c, is defined as the fraction of 
links existing among its neighbours: 

c _ Y-jk "ti'ijk'ik, _ y L j k'i'j"jk"v (X) 
ki(ki -l)/2 I,a (i,,(iu 

When plotted against ku for most real networks c, displays a decreasing trend, in- 
dicating the presence of hierarchy. Unstructured networks would instead display a 
flat behaviour. An average of c ( - over all vertices measures the overall probability 
that two vertices, both joined to a third one, are also connected to each other. This 
average clustering is found to be much larger than expected by chance. 



High clustering is often combined with a small value of the average distance 
between pairs of vertices, and the term small world effect is used to describe this 
combination J5J . Another property of interest is the existence in large networks of 
(sometimes overlapping) communities, modules, and "rich clubs" (TJ|2). Besides 
their structural importance, these topological properties have a deep effect on the 
dynamical processes that take place on networks. Examples of processes whose de- 
pendence on the underlying network structure has been studied in detail include 
the spreading of epidemics 1581 . percolation J4), critical phenomena ||59l , the ex- 
change of wealth l60l |6D . and the sandpile lf62l and Bak-Sneppen models them- 
selves EEgEaEEIlolimmi!!. 
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All these interesting properties are detected by comparing the topology, or the dy- 
namical performance, of a network with a null model providing a randomized ver- 
sion of it. Graph models are therefore important benchmarks for understanding com- 
plex networks. Moreover, they are also used to test candidate mechanisms believed 
to be responsible for the onset of a particular topological feature, thus providing an 
insight into realistic network formation processes. The vast majority of theoretical 
models can be grouped in two broad classes. On one hand, one has static models 
with a fixed number of links and specified connection probabilities between them. 
This generates an ensemble of networks whose expected topological properties can 
be obtained analytically. The prototype of all static models is the random graph, that 
we shall briefly review in section U.2.11 On the other hand, one has evolving models 
with a variable number of vertices and links, that grow under specified stochastic 
rules. The earliest example of these models is the one proposed by Barabasi and Al- 
bert ll63l . and we shall present it in section [322] Most models proposed in the last 
decade are (often nontrivial) modifications of these two simple ones. For instance, 
in section U.2.3l we briefly review the fitness model, where the idea that the connec- 
tion probability depends on some vertex-specific fitness has been introduced. As we 
have anticipated in the Introduction, besides these two well established frameworks 
a third, more recent approach focuses on networks shaped by the interplay between 
dynamical processes defined on them and the readjustment of topology. Our main 
focus is exactly an example of such adaptive models, which shall be presented in 
detail separately in section [4] 



3.2.1 The random graph model 

For an undirected network with N vertices, the maximum possible number of edges 
(excluding self-loops) one can draw is given by L max = N(N — l)/2. If all these 
edges are present, the graph is said to be "complete". At the opposite limit, if no 
edge is present, the graph is said to be "empty". In between these two extremes, one 
can form instances of more or less dense networks by drawing each of the possible 
edges independently with a probability p. This defines the random graph model 
0, whose only parameter (besides N) is p. The case p = recovers the empty 
graph, while the case p = 1 yields the complete one. The expected number (average 
(• • •} over the ensemble of possible realisations) of edges in a random graph with 
probability p is given by 

and the expected degree, which is the same for all vertices, is 



(k)=p(N-l)^pN. 



(10) 



12 



Guido Caldarelli and Diego Garlaschelli 



For N large the correlations between the various degrees can be neglected (degrees 
are not independent in a finite graph), and the degree distribution P(k) can be ap- 
proximated by the probability that a single vertex has degree k. To obtain a vertex 
with degree k, we must have k times a successful event whose probability is p, and 
(N — 1 — k) times an unsuccessful event whose probability is (1 —p). Since this can 
happen in 

(N-£\ (N-l)l 



k J (N-\-k)\k\ 



(11) 



combinations, we have 



P(k)=( N - 1 )p k (l-pf- 1 - k (12) 



The distribution is automatically normalized since 

N fp(k) = [p + (l- P )f- i =l. (13) 

k=0 

The above binomial distribution is well approximated by a Poisson distribution in 
the limit N — > °° and p — > (with Np kept constant): 

, N (Np) k e-P N (k) k e-M 

P(k) w ^—^ = — . (14) 

k\ k\ 

where we have used eq.dTOt. Thus the degree distribution of the random graph de- 
cays exponentially, and is well concentrated about the average value (k). This is in 
stark contrast with the scale-free behaviour of most real networks, characterized by 
the power-law tail of P(k). 

The expected value of the average nearest neighbours degree defined in eq.© is 
the same for all vertices as well, and equals the average degree: 

p 2 (N-l) 2 

(n = ^^=P(N-i) (is) 

This means that, as expected, in the random graph no (dis)assortative mixing is 
present, and the degrees of neighbouring vertices are uncorrected. 

Similarly, for the expected value of the clustering coefficient defined in eq.© 
one finds 

p 3 (jV-l)(jV-2) 

{c) = p>(n-i)(n-2) =p (16) 

so that no hierarchical structure is present. Moreover, if the value of p is chosen in 
such a way that the expected number of links in eq.© matches the empirically ob- 
served one, then the resulting value of (c) is much smaller that the observed average 
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clustering coefficient. 

One can also derive an upper bound for the average distance, by considering the 
diameter D (defined as the maximum distance between pairs of vertices). Exploring 
the graph as in a breadth first search algorithm, one finds that if the number of first 
neighbours of a vertex is (k), and if the network is connected, then the number of 
vertices visited after d steps must be approximately (k) d . The total number N of 
vertices is reached in at most D steps, so that 

- of-m (17) 

Therefore the average distance scales at most logarithmically with N, a feature 
which is consistent with the small values observed. 

In summary, for random graphs 

• no scale-free degree distribution is present; 

• degrees of neighbouring vertices are uncorrelated; 

• the clustering is too weak and not hierarchical; 

• no small world effect is present, even if the average distance is small. 



3.2.2 The Barabasi-Albert model 



The Barabasi-Albert model 11631 is the prototype of evolving network models, where 
it is assumed that the system grows at any time step. Both the number of vertices 
and the number of edges increase with time, since new vertices enter the network 
and are assumed to connect to the pre-existing ones with a probability proportional 
to the degree of the latter {rich-get-richer mechanisms). This implies that newcom- 
ers establish their connections preferentially with vertices that already have a large 
degree. It is then clear that the two novel ingredients in this model of network for- 
mation are growth and preferential attachment. The main success of the model is 
that these two simple rules produce naturally scale-free networks with degree dis- 
tribution P(k) oc k~Y (where y = 3). 

In order to derive this result, we rephrase the model quantitatively. The initial (f = 
0) state consists of A^o vertices and no link. At each timestep t a new vertex attached 
to niQ new edges enters the system. The loose ends of these niQ edges connect to niQ 
pre-existing vertices, chosen with a probability fl(fe,,f ) proportional to their degree 
at time t : 

n ^ = ^rh (18) 

This directly implies that the numbers of vertices and edges at time t are given by 



N(t) =N + t 
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m(t) = Wki{t)=m Q t. (19) 

Z j 

Using a continuous-time approximation, one can write the time evolution of the 
degree k, by noting that its rate of increase is 

dkt kg) mokijt) ki{t) 

= w ° nfer) = m LM) = = ~2i~ (20) 

The above differential equation can be solved using the initial condition k(t/) = mo, 
where f,- is the time when vertex ; entered the network. The solution is 

ftV' 2 

k i (t)=m (~) (21) 

showing that the degree grows with the square root of time. This relation allows us 
to compute the exponent of the degree distribution. The probability P(kj < k) that a 

vertex has a degree smaller than k is P(ki <k)~p(^ti > ^ ■ Since vertices enter at 
a constant rate, the distribution of their injection times is uniform between the initial 
time tj = and the current time f; = t . In this interval, P{u) = 1 /N(t ) = 1 /(No + t). 
This implies 

/ mh\ ( mh\ mh 1 

T^H-T'^H-^^ (22) 

from which we have 

y ' dk (N + t)k 3 

Therefore, we find that the degree distribution is a power law with a value of the 
exponent 7=3. 



This derivation highlights the difficulty, as compared with static models, of deriv- 
ing exact results for growing networks, which are therefore often explored by means 
of numerical simulations. Despite this difficulty, a series of results have been derived 
for the model. We only list some of them by reporting that networks generated by 
the Barabasi- Albert model 

• have power-law distributed degrees (as shown above); 

• have no correlations between degrees of neighbouring vertices j4j; 

• show a clustering larger than the random graph case l64ll65ll : 

• display the small-world effect ||66l . 
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3.2.3 The fitness model 



A completely different approach to obtain self-similar networks is to extend in a 
suitable way the random graph model defined in section I?. 2. II In the latter, all ver- 
tices are assumed to be statistically equivalent, so unsurprisingly no heterogeneity 
emerges. By contrast, one can define a static model where heterogeneity is explicitly 
introduced at the level of vertices. In particular, Caldarelli et al. have proposed a 
model where each vertex i (i — 1, . . . ,N) is assigned a fitness xi drawn from a spec- 
ified distribution p(x). Then, each pair of vertices i and j is sampled, and a link is 
drawn between them with a fitness-dependent probability py = f(xi,Xj). The ex- 
pected topological properties of the network can be easily computed in terms of 
p(x) and f(x,y) |7] |67] |68) ■ For instance, the expected degree of vertex i is 

(**>=£/>y = £/(*/,*>) (24) 

j j 

For N large, the discrete sum can be approximated by an integral. Thus the expected 
degree of a vertex with fitness x is 

k(x)=N j ' f{x,y)p(y)dy (25) 

where the integration extends over the support of p (x). If one consider the cumula- 
tive fitness distribution and the cumulative degree distribution defined as 

p>(x)= f + p{x)dx' P>(k)= f + P(k')dk' (26) 

Jx Jk 

then the latter can be easily obtained in terms of the former as 

P > (k)=p > [x(k)] (27) 
where x(k) is the inverse of the function k(x) defined in eq.(l25l. 



Similarly, the expected value of the average nearest neighbours degree defined in 

e qd3> is 

,,„„, )-,!>:, kj LjkPijPjk 

{ki } = -(*r = ~Y^r (28) 

and the expected value of the clustering coefficient defined in eq.® is 

, . _ LjkPijPjkPki LjkPijPjkPki 



(**}((*,) -l)/2 LjkPtjPki 



(29) 



As for eq.( t24) . the above expressions can be easily rephrased in terms of integrals 
involving only the functions f(x,y) and p(x), upon which all the results depend. 
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The constant choice f(x,y) = p is the trivial case corresponding to a random 
graph, irrespectively of the form of p{x). The simplest nontrivial choice can be 
obtained requiring that the fitness-dependent network has no degree correlations 
other that those introduced by the local properties alone. It can be shown that this 
requirement leads to the form ||69lr70l 

f(x,y) = (30) 
1 + zxy 

where z is a positive parameter controlling the number of links. Apart for the so- 
called structural correlations induced by the degree sequence [69 70|, higher-order 
properties are completely random, as in the configuration model j4j[7T). Whenz << 
1, the above connection probability reduces to the bilinear choice 

f{x,y)=zxy (31) 

In this case, a sparse graph is obtained where structural correlations disappear. Also, 
from eq. d24l i one finds that (kj) <x x, . If one chooses a power-law fitness distribu- 
tion p(x) , it is therefore clear that the degree distribution will have exactly 
the same shape: P(k) oc k~Y. In the more general case corresponding to eq.d30"il. the 
same choice for p (x) yields again a power-law degree distribution, with a cut-off 
at large degree values that correctly takes into account the requirement k < N for 
dense. Equation (f30b also generates disassortativity and hierarchically distributed 
clustering, both arising as structural correlations imposed by the local constraints. 
For sparse networks, corresponding to eq.OTT). these correlations disappear. 

Another interesting choice is given by 

f(x,y) = 0{x + y-z) p(x) = e~ x (32) 

where z, which again controls the number of links, now plays the role of a posi- 
tive threshold. This choice yields again a power-law degree distribution P(k) oc k~ 7 
(where now y = 2), anticorrelated degrees with k m (k) « k~ l , and hierarchically 
distributed clustering c(k) « k~ 2 (times logarithmic corrections) J7] [67] |68) . Re- 
markably, it has been shown that both eq.fl30"ll and eq.(|32l are particular cases of 
a more general expression obtained by introducing a temperature-like parameter 
(72) ■ Equation ( f30b , with p (x) « x~Y, corresponds to the finite-temperature regime, 
where the temperature can be reabsorbed in a redefinition of x and z. By contrast, 
eq.d32l corresponds to the zero-temperature regime where the structural correla- 
tions disappear and the graph reaches a sort of "optimized" topology l72l . In all 
these cases, the average distance is small. In summary, for a series of reasonable 
choices the networks generated by the fitness model display 

• a scale-invariant degree distribution; 

• correlations between neighbouring degrees; 

• hierarchically distributed clustering; 

• a small-world effect. 
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As we have anticipated in the Introduction and in section 13.21 more recent ap- 
proaches to the modelling of complex networks have considered the idea that the 
topology evolves under a feedback with some dynamical process taking place on 
the network itself (see for instance refs. HI HU EU [74] E2] UE 123 ED). Among 
the various contributions, three groups have considered a possible connection with 
Self-Organized Criticality 1161 17411751 . 



Bianconi and Marsili |74| have defined a model where slow network growth, de- 
fined as the gradual addition of links between randomly chosen vertices, is combined 
to fast relaxation, defined as the random rewiring of links connected to congested 
(toppling) vertices. To avoid the collapse to a complete graph, dissipation is also 
introduced, allowing toppling nodes to lose all their links at a given rate. The out- 
comes of the model depend on the dissipation rate and on the probability density 
function for the toppling probabilities to be assigned at each vertex. A particular 
choice of these quantities drives the system to a stationary state characterized by a 
scale-free topology and a power-law distribution for toppling avalanches. 

Fronczak, Fronczak and Holyst f75| have proposed a model where no parameter 
choice is required in order to drive the system to the critical region. They consid- 
ered the sandpile dynamics defined in section 12.2.11 but where each vertex has a 
different critical height equal to its degree, as in other previous studies J62) - In ad- 
dition, they assumed that after an avalanche of size A, the A ends of links in the 
network that have not been rewired for the longest time are rewired to the initiator 
of the avalanche. In this way, the avalanche area distribution and the degree distri- 
bution evolve in time, and at the stationary state become very similar and scale-free. 

Garlaschelli, Capocci and Caldarelli J6) have introduced another fully self- 
organized model where the Bak-Sneppen dynamics defined in section 12.2.21 takes 
place on a network whose topology is in turn continuously shaped by the fitness 
model presented in section 13.2.31 Remarkably, they find that the mutual interplay 
between topology and dynamics drives the system to a state characterized by scale- 
free distributions for both the degrees and the fitness values. These unexpected prop- 
erties differ from what is obtained when the two models are considered separately. 
The rest of the chapter is devoted to a detailed description of this model. 



4.1 Motivation 

We have already mentioned that the topology of a network affects dramatically the 
outcomes of dynamical processes taking place on it 0] H [5) . On the other hand, 
the idea behind the fitness model presented in section [3~.2.3l captures the empirically 
observed result l53l l54l l79l that the topology of many real networks is strongly de- 
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pendent on some vertex-specific quantity. Clearly, these results imply that in gen- 
eral one should consider the mutual effects that dynamics and topology have on each 
other. Unfortunately, the overwhelming majority of studies have instead considered 
the two processes separately, by postulating either a scenario where the topology 
evolves over a much longer timescale than the dynamics, or the opposite situation 
where the dynamical variables evolve much more slowly than the topology (and are 
therefore assumed fixed as in the fitness model itself). In cases when there is indeed 
such a sharp separation of timescales, these approaches are helpful. But in many 
cases the topological evolution and the dynamics may occur at comparable rates, in 
which case the decoupled approach gives no insight into the real process. Moreover, 
even when the timescales are indeed well separated, it is clear that the variables in- 
volved in the slower of the two processes must be specified as external parameters, 
and ad hoc assumptions must therefore be made. For instance, when considering the 
spreading of epidemics on a network one should assume an arbitrary fixed topology. 
Similarly, when a network is formed according to the fitness model, one should as- 
sume an arbitrary distribution for the fitness variables. 

These motivations lead Garlaschelli et al. J6) to define a self-organized model 
where ad hoc specifications of any fixed structure, either in the topology or in the 
dynamical variables, are unnecessary. Rather, it is the interplay between dynamics 
and topology that autonomously drives the system to a stationary state. The choice 
of both the dynamical rule and the graph formation process was driven by the in- 
terest to highlight the novel effects arising uniquely by the feedback introduced 
between them. Therefore, two extremely well understood models where chosen. 
On one hand, the extremal fitness dynamics of the Bak-Sneppen model (see sec- 
tion ^. 2. 2"l i. and on the other hand the fitness network model (see section [3.2.3l ). As 
we have shown in section 13.2.31 the topology generated by the fitness model can 
be completely calculated for any distribution of the fitness values. Similarly, the 
outcomes of the Bak-Sneppen model on several static networks are well studied 
JS [281 [38] [39] SO] SH S21 |43l . On a generic graph, each of the N vertices is as- 
signed a fitness value x,, initially drawn from a uniform distribution between and 
1, as in the one-dimensional case. At each timestep the species ; with lowest fitness 
and all its k, neighbours undergo a mutation, and kj + 1 new fitness values (drawn 
from the same uniform distribution) are assigned them. On regular lattices l8l l39ll . 
random graphs |28l . small-world |j40l and scale-free BT1 l42l l43l networks it has 
been shown that, as for the one-dimensional model, at the stationary state the fitness 
values are uniformly distributed above a critical threshold T. The only dependence 
on the particular topology is the value of t O [28l [39l |40l SU |42l SSJ . In partic- 
ular, t vanishes for scale-free degree distributions with diverging second moment 

EDIEIESl. 

While these more complicated networks are closer to realistic food webs l49l , as 
long as the graph is static the model leads to the ecological paradox that, after a mu- 
tation, the evolved species inherits the same connections of the previous species. By 
contrast, macroevolution is believed to be at the same time the cause and the effect 
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of food web dynamics |j48l . In particular, after a mutation, a species is expected to 
develop a new set of interactions with the other species. 



4.2 Definition 

In order to overcome this problem, Garlaschelli et al. assumed that the Bak-Sneppen 
dynamics is combined with a fitness-driven link updating. At the initial state the 
network is generated as in the fitness model, and between all pairs of vertices ; and j 
a link is drawn with probability f(xi,xj) (where the x,'s are the initial fitness values). 
Then, whenever a species i is assigned a new fitness x' t , all the set of connections 
between i and the other vertices j ^ i are drawn anew with updated probability 
f(x' i ,Xj). This automatically implies that major mutations (a large change in jt,) are 
associated with very different connection probabilities, while little changes lead to 
almost equiprobable interactions. An example of this evolution rule is depicted in 
figure [3] 



Fig. 3 Example of graph evolution in the self-organized model. The minimum-fitness vertex 
(black) and its two neighbours (gray) undergo a mutation: three new fitness values are assigned 
them (light grey), and new links are drawn between them and all the other vertices. 

Two possible choices for updating the fitness of a mutating vertex where pro- 
posed. In the original paper J6), the usual prescription was adopted: each neighbour 
j of the minimum-fitness vertex receives a fitness drawn anew from the uniform 
distribution on the unit interval. This means 



where rj is uniformly distributed between and 1 . Therefore, xj is completely up- 
dated, independently of its degree kj. In another study l80l . a weaker rule was as- 
sumed. In particular, the fitness of each neighbour j is assumed to change only by 
an amount proportional to 1 /kf. 



Xj (t+i) = ri 



(33) 



*;(' + !) = r 



T7 + 



l 




(34) 



■j 
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where again 77 is a random number uniformly distributed between and 1 . Under 
this second assumption, Xj is completely modified if the only neighbour of j is the 
minimum-fitness vertex, in which case kj = 1. If j has kj — 1 additional neighbours, 
a share (kj — l)/kj of Xj is unchanged, and the remaining fraction Xj/kj is updated 
to rj/kj. This makes hubs affected less than small-degree vertices. Clearly, it also 
implies that the probability of connection to all other vertices varies by a smaller 
amount. In what follows we shall present both analytical and numerical results de- 
rived under the first choice j 6 1 . Numerical simulations of the model under the second 
rule are reported in ll80l . 



4.3 Analytical solution 

Remarkably, the model is exactly solvable for any choice of the connection prob- 
ability f(x,y) 0. Indeed, one can write down a master equation for the fitness 
distribution p(x,t) at time t: 

?Pi^}=S"(x,t)- r ° ut (x,t) (35) 

where r"'(x,t) and r" l "(x,t) are the fractions of vertices with fitness x entering 
and exiting the system at time t respectively. If a stationary distribution (time- 
independent) distribution p (x) exists, it is found by requiring 

^A=Q r in (x) = r" u, (x) (36) 

at 

where at the stationary state the quantities no longer depend on time. If one man- 
ages to write down r"'(x) and r ou, (x) in terms of f(x,y) and p(x), then the above 
condition will give the stationary form of p (x) for any choice of f(x,y). 

To this end, it is useful to introduce the distribution q(m) of the minimum fitness 
m = x m i„. For x small enough, p (x) must be very close to q(x)/N (the distribution of 
all fitness values must be approximated by the correctly renormalized distribution of 
the minimum). The range where p (x) w q[x) /N holds can be defined more formally 
by introducing the fitness value T such that 

,. Np(x) f = 1 x < T 

hm , Y { , ~ (37) 

iV^oo q (x) \>1 x>z 

This means that in the large size limit the fitness distribution for x < T is determined 
by the distribution of the minimum. After an expression for p(x) is derived, the 
value of T can be determined by the normalization condition 

1 

p(x)dx=l (38) 
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as we show below. Note that we are not assuming from the beginning that T > 
as is observed for the Bak-Sneppen model on other networks. It may well be that 
for a particular choice of f(x,y) eq.d38ll yields T = 0, signalling the absence of a 
nonzero threshold. Also, note that lirrijv_ M) <> #(x) = forx > T, since eq.(l37l) implies 
that the minimum is surely below T. Thus the normalization condition for q(x) reads 
/ T q(x)dx = 1 as N — > °°. 

The knowledge of q(m) allows one to rewrite r ,n (x) and r out {x) as r'"(x) = 
f q(m)r in (x\m)dm and r°'" (x) = J q(m)r" 1 " (x\m)dm, where r'"(x\m), r" l "(x\m) are 
conditional probabilities corresponding to the fractions of vertices with fitness x 
which are added and removed when the value of the minimum fitness is m. Let us 
consider r" 1 (x) first. If the minimum fitness is m, then 1 + k(m) new fitness values are 
updated, where k(m) is the expected degree of the minimum-fitness vertex. Since 
each of these 1 + k{m) values is uniformly drawn between and 1, one has 

= ^ (39) 
independently of x. This directly implies 

r in (x) = C q{mY n (x\m)dm = 1 + ^""^ (40) 
Jo N 

where (£„„■„) = f () T q(m)k(m)dm is the average degree of the vertex with minimum 
fitness, a quantity that can be derived independently of k(m) as we show below. 
Now consider r° ut (x), for which the independence on x does not hold. For x < T, 
r° ut (x\m) = 1/N if x = m since the minimum is surely replaced. For x > T, the 
fraction of vertices with fitness x that are removed equals p (x) times the probability 
that a vertex with fitness x is connected to the vertex with minimum fitness m. This 
probability depends on the fitness values x' and m' that the vertices currently having 
fitness x and m had at the most recent update of the link connecting them, and simply 
equals f(x',m') J6). This means 

r m "{x\m) = e{T-x) 5{ * X ~ m) +0{x-%)p(x)f{x,m) (41) 

where (x) = 1 if x > and © (x) = otherwise, and 8 (x) is the Dirac delta func- 
tion. An integration over q(m)dm yields 



r out ( x ) = / q{m)r m (x\m)dm 
o 

q{x)/N x<r 

p(x) Jq q(m)f(x,m)dm x>T 
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Finally, one can impose eq.d36ll at the stationary state. If x < T, this yields q(x) = 
1 + (kmin) independently of x. Combining this result with q(x) = for x > X as 
N — > oo, one finds that the distribution of the minimum fitness m is uniform between 
and v. 

q{m) = {\ + {k min ))©{l-m) (43) 
Requiring that q(m) is normalized yields 



{kmin) = — (44) 



Therefore eq.(|40b can be written as 



r in {x) = — Vx (45) 



If x > t, eq.(l36b implies 

p{x) 



<(x) 



/* T q(m)f(x, m)dm 

r in (x) 
So q{m)f(x,m)dm 
1 

zN Jo q(m)f(x, m)dm 
1 

N $f(x,m)dm 



(46) 



which must be equal to p (x) = q(x) /N = (tN) 1 for x < X. Using this relation, the 
exact solution for p(x) at the stationary state is found [6]: 

(tAO -1 X < T 

N /o f(x,m)dm 



where T is determined using eq.(l38ll, that reads 

dx 



Qf(x,m)dr, 



= N-\ (48) 



The above analytical solution holds for any form of f(x,y). As a strikingly novel re- 
sult, one finds that p (x) is in general no longer uniform for x > x. This unexpected 
result, which contrasts with the outcomes of the Bak-Sneppen model on any static 
network, is solely due to the feedback between topology and dynamics. At the sta- 
tionary state the fitness values and the network topology continue to evolve, but the 
knowledge of p (x) allows to compute the expected topological properties as shown 
in section U. 2. 3 1 for the static fitness model. 
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In what follows we consider specific choices of the connection probability f(x,y). In 
particular, we consider two forms already presented in section U.2.31 Once a choice 
for f(x,y) is made, one can also confirm the theoretical results with numerical sim- 
ulations. As we show below, the agreement is excellent. 



4.4.1 The random neighbour model 

As we have noted, the trivial choice for the fitness model is f(x,y) = p, which 
is equivalent to the random graph model. When the Bak-Sneppen dynamics takes 
place on the network, this choice removes the feedback with the topology, since the 
evolution of the fitness does not influences the connection probability. Indeed, this 
choice is asymptotically equivalent to the so-called random neighbour variant |28 j 
of the Bak-Sneppen model. In this variant each vertex has exactly d neighbours, 
which are uniformly chosen anew at each timestep. Here, we know that for a random 
graph the degree is well peaked about the average value p(N — 1) (see section lT.2.11 ). 
thus we expect to recover the same results found for d = p(N — 1) in the random 
neighbour model. Indeed, eq.d47l> leads to 

p(x) = < ) ' , (49) 



(50) 



and eq.(l48t yields 




1+pN 



The reason for the onset of these three dynamical regimes must be searched for in 
the topological phases of the underlying network. For p large, there is one large con- 
nected component that spans almost all vertices. As p decreases, this giant cluster 
becomes smaller, and several separate clusters form. Below the critical percolation 
threshold p c ~ 1 /N (HE], the graph is split into many small clusters. Exactly at the 
percolation threshold p c , the sizes of clusters are power-law distributed according 
to P(s) oc s~ a with a = 2.5 J4). Here we find that the dense regime pN — > °° is qual- 
itatively similar to a complete graph, where many fitness values are continuously 
updated and therefore T — > as in the initial state (thus p (x) is not step-like). In the 
sparse case where pN = d with finite d > 1 as N — > °°, then each vertex has a finite 
number of neighbours exactly as in the random neighbour model, and one correctly 
recovers the finite value T = (1 +d)~ l found in ref. l28l . The subcritical case when 
p falls faster than 1 /N yields a fragmented graph below the percolation threshold. 
This is qualitatively similar to a set of isolated vertices, for which T — > 1 . It is in- 
structive to notice from eq.d47li that the choice f(x,y) = p is the only one for which 
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p (x) is still uniform. This confirms that, as soon as the feedback is removed, the 
novel effects disappear. 

4.4.2 The self-organized configuration model 

Following the considerations in section 13.2.31 the simplest nontrivial choice for 
f(x,y) is given by eq.(l30ll. For a fixed p(x), this choice generates a fitness- 
dependent version of the configuration model |4][7T), where all graphs with the same 
degree sequence are equiprobable. All higher-order properties besides the structural 
correlations induced by the degree sequence are completely random [69, 70). In this 
self-organized case, the degree sequence is not specified a priori and is determined 
by the fitness distribution at the stationary state. Inserting eq.([30b into eq.(l47b one 
finds a solution that for N — > °° is equivalent to [6 j 



Here <j)(x) denotes the ProductLog function, defined as the solution of (pe^ = x. 
Again, the above dynamical regimes are related to three (subcritical, sparse and 
dense) underlying topological phases. This can be ascertained by monitoring the 
cluster size distribution P(s). It is found that P(s) develops a power-law shape 
P(s) s~ a (with a = 2.45 ±0.05) when d = zN is set to the critical value d c = 
1.32 ±0.05 J6) (see fig. |4j, which therefore represents the percolation threshold. 
This behaviour can also be explored by measuring the fraction of vertices spanned 
by the giant cluster as a function of d (see fig. [5). This quantity is negligible for 
d < d c , while for d > d c it takes increasing finite values. Also, one can plot the av- 
erage size fraction of non-giant components. As shown in the inset of fig. [5] this 
quantity diverges at the critical point where P{s) is a power law. 

The analytical results in eq.dSTb mean that p (x) is the superposition of a uniform 
distribution and a power-law with exponent — 1 . The decay of p (x) for x > X is en- 
tirely due to the coupling between extremal dynamics and topological restructuring. 
It originates from the fact that at any time the fittest species is also the most likely 
to be selected for mutation, since it has the largest probability to be connected to the 
least fit species. This is opposite to what happens on fixed networks. The theoretical 
predictions in eqs.(l5TT> and d52l can be confirmed by large numerical simulations. 
This is shown in fig|6j where the cumulative fitness distribution p>(x) defined in 
eq.j26]l and the behaviour of t(zN) are plotted. Indeed, the simulations are in very 
good accordance with the analytical solution. Note that, as we have discussed in 




(51) 



where T, again obtained using eq.d48li. is 




zN = d 



(52) 
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Fig. 4 Cluster size distri- 
bution. Far from the criti- 
cal threshold (d — 0. 1 and 
d = 4), P(s) is well peaked. 
At d c = 1.32, P{s) oc S - a 
with a = 2.45 ±0.05. Here 
N = 3200. (After ref. (5j). 
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Fig. 5 Main panel: the frac- 
tion of nodes in the giant 
component for different net- 
work sizes as a function of d. 
Inset: the non-giant compo- 
nent average size as a function 
of d for N = 6400. (After ref. 
0). 
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section U.2.31 in the sparse regime z <C 1 one has f(x,y) ps zxy. Here, this implies a 
purely power-law behaviour p (x) « x~ 1 for x > X. Therefore p> (x) is a logarithmic 
curve that looks like a straight line in log-linear axes. In the dense regime obtained 
for large z, the uniform part gives instead a significant deviation from the power-law 
trend. This shows one effect of structural correlations. 



Other effects are evident when considering the degree distribution P(k). Using 
eq.(l25t one can obtain the analytic expression of the expected degree k(x) of a vertex 
with fitness x: 

, , . 2 l+zx zx — ln(l+sc) 

k(x) = In — + ^ '- (53) 

Computing the inverse function x(k) and plugging it into eq.(l27b allows to obtain 
the cumulative degree distribution P>(k). Both quantities are shown in figH] and 
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CDF 




0.001 0.0050.01 0.05 0.1 0.5 1 

Fig. 6 Main panel: cumulative density function p>(x) in log-linear axes. From right to left, z = 
0.01, z = 0.1, z = 1, z = 10, z = 100, z = 1000 (N = 5000). Inset: log-log plot of r(zN). Solid 
lines: theoretical curves, points: simulation results. (After ref. (6*1). 




Fig. 7 Left: k(x) (N = 5000; from right to left, z = 0.01, z = 0.1, z= 1, Z= 10, z = 100, z = 1000). 
Right: P>(£) (same parameter values, inverse order from left to right). Solid lines: theoretical 
curves, points: simulation results. (After ref. (6)). 

again the agreement between theory and simulations is excellent. For small z, k(x) 
is linear, while for large z a saturation to the maximum value k max = k(l) takes 
place. As discussed in section 13.2.31 this implies that in the sparse regime P{k) 
has the same shape as p(x). Another difference from static networks is that here T 
remains finite even if P(k) k~Y with y < 3 1411 42 43 1. For large z the presence of 
structural correlations introduces a sharp cut-off for P{k). 
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We have presented a brief, and by no means complete, summary of the ideas that 
inspired much of the research on scale-invariance and self-similarity, from the early 
discovery of fractal behaviour to the more recent study of scale-free networks. We 
have highlighted the importance of understanding the emergence of the ubiqui- 
tously observed patterns in terms of dynamical models. In particular, the framework 
of Self-Organized Criticality succeeds in explaining the onset of fractal behaviour 
without external fine-tuning. According to the SOC paradigm, open dissipative sys- 
tems appear to evolve spontaneously to a state where the response to an infinites- 
imal perturbation is characterized by avalanches of all sizes. We have emphasized 
the importance of introducing similar mechanisms in the study of networks. In par- 
ticular, we have argued that in many cases of interest it is not justified to decouple 
the formation of a network from the dynamics taking place on it. In both cases, one 
is forced to introduce ad hoc specifications for the process assumed to be slower. 
Indeed, by presenting an extensive study of a self-organized network model, we 
have shown that if the feedback between topology and dynamics is restored, novel 
and unpredictable results are found. This indicates that adaptive networks provide a 
more complete explanation for the spontaneous emergence of complex topological 
properties in real networks. 
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